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(57) Abstract 

In combined systems of different radio systems, for example in a combined system of the radio access network (RAN) of the IMT-2000 
system and the core network (MSC) of the GSM system, a problem exists in transferring encryption settings from a system element to the 
others. The present invention relates to a method of setting encryption for a connection in such a combined system, where the handling of 
the encryption settings of the switching centre (MSC) and the base station (BTS) of the radio network is carried out at different protocol 
layers than the handling of the encryption settings of the mobile terminals (MT). In the method, encryption is arranged for the connection 
between the radio access network (RAN) and the mobile terminal (MT). and an encryption setting is transmitted from the switching centre 
(MSC) to the control unit (BSC) of the radio access network (RAN). According to the invention, the method is characterized in that an 
encryption setting is transferred from the control unit (BSC) to the mobile terminal (MT) transparently from the point of view of the base 
station. 
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Method of setting encryption for a connection in a radio system 
Field of tfie invention 

The present invention relates to a method of setting encryption for a 
5 connection in a radio system that comprises a plurality of mobile terminals, at 
least one switching centre and at least one radio network unit communicating 
with the switching centre, the radio network unit further comprising at least one 
control unit and at least one base station under its control. In the radio system, 
the handling of the encryption settings of the switching centre and the base 
10 station is performed at different protocol layers than the handling of the 
encryption settings of the mobile terminals. 

Background of the Invention 

The present-day requirement of public radio systems is mutual 

15 compatibility. At times, it is further required that units of different systems can 
be combined into a workable entity, for example the use of a base station 
system in core networks of different radio systems. Figure 1 shows such a 
combination of a plurality of radio systems, in which a Radio Access Network 
(RAN) is connected to core networks of different systems, in the figure to the 

20 core networks of a Global System for Mobile Communications (GSM), 
International Mobile Telecommunication (IMT-2000), General Packet Radio 
Service (GPRS) and Integrated Sen/ices Digital Network (ISDN). Such a radio 
access network RAN is planned to be implemented in the IMT-2000 system of 
the future. By means of the RAN network, a radio connection is established to 

25 subscribers of several core networks. Consequently, it is also referred to as a 
Generic Radio Access Network (GRAN). Each core network provides services 
to its own subscribers. The mobile terminal (MT) is thus connected to a base 
station BTS of the radio access network RAN via the radio path over the radio 
interface. Via the BTS, the connection is transfen^ed from the radio access 

30 network RAN to the home core network of the mobile terminal MT over the 
interface 1^. The 1^, interface refers to an open interface that can be used to 
interconnect the RAN of different systems and a Core Network (CN). A core 
network refers to a Mobile Services Switching Centre (MSC) and the other 
units in the network, such as the Visitor Location Register (VLR), the Home 

35 Location Register (HLR), etc. depending on the system. The l„ is illustrated as 
comprising the BN protocol (Bearer Negotiation) of layer 3 and the lower 
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physical transmission layers. A core network can also be made up of separate 
packet service nodes such as General Packet Radio Service (GPRS). Serving 
GPRS Support Node (SGSN) and Gateway GPRS Support Node (GGSN) of 
the GSM. 

5 Figure 2 shows the connection of the GSM core network to the radio 

access network RAN in closer detail. The RAN consists of at least one base 
station controller (BSC) and base stations BTS under its control. Unlike with 
operation of the GSM system, the signaling between the RAN network and the 
mobile temriinal in the IMT-2000 system is often transparent to the base station 

10 BTS. Thus, the stnjcture of the BTS functioning as a repeater in the signaling 
between the BSC and the MT is simpler than in traditional mobile 
communications systems. The base station controller BSC routes the 
messages from the mobile terminal MT, received via the base station BTS, to 
the mobile services switching centre MSC of the GSM system, and vice versa. 

15 The problem with connecting the IMT-2000 system radio access 

network RAN and. e.g.. the GSM system core network to one another is 
arranging encryption for the connections. In the IMT-2000 system, encryption 
is implemented between the mobile terminal MT and the core network MSC, 
which makes traffic transparent from the point of view of the radio access 

20 network RAN. In the GSM system, encryption is implemented at the air 
interface between a mobile station MS and a base station BTS. The next 
examines in closer detail the problem caused by a combined system in the 
light of Figures 3-6. 

Figure 3 illustrates a theoretical layer description for a connection in 

25 the GSM system entity, in which identically-named protocols of units 
connected to each other communicate with each other. For reasons of clarity, 
physical transmission layers 1 and 2 that do not take part in the encryption are 
marked with dotted lines. Boxes circled with solid lines in the figures belong to 
layer 3. Of the protocols shown in the figure, CC (Call control) cames out call 

30 control and MM (Mobility Management) location management of the mobile 
station MS. In the GSM system, these protocols do not take part in 
implementing encryption for the connection. 

Figure 4 is a signaling diagram for setting of encryption in the GSM 
system. Figure 4 also shows the taking part of the protocol boxes of Figure 3 in 

35 the setting of the encryption. With a BSSAP protocol, the mobile sen/ices 
switching center MSC transmits an encryption start command 41 
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CIPHERING_MODE_COMMAND to the BSSAP protocol of the base station 
controller BSC. The BSSAP (BSS Application Part) protocol corresponds to 
the BN protocol. BSC-intemally, the start command is transferred in message 
42 from the BSSAP protocol to the BTSM protocol (BTS Management) that is 
5 able to communicate with the con-esponding protocol of the base station BTS. 
The BTSM protocol of the base station controller BSC thus transfers the 
encryption comnriand to the BTSM protocol of the BTS in message 44 
ENCRYPTION_COMMAND. which includes a CIPHERING_MODE_ 
COMMAND message of an RR protocol (Radio Resource Management), 

10 meant to be transmitted to the mobile station MS. BTS-intemally, the 
encryption command is transfen-ed, in message 45, from the BTSM protocol to 
an RR' protocol which is part of the RR protocol and thus capable of 
communicating with the RR protocol of the mobile station MS. The RR' 
protocol of the base station BTS transfers the 

15 CIPHERING_MODE_COMMAND message, delivered within message 44, to 
the RR protocol of the MS (message 46). The RR protocol of the mobile 
station MS acknowledges the encryption setting by transmitting an 
acknowledgement message 47 CIPHERING_ MODE_COMPLETE to the RR 
protocol of the base station controller BSC. BSC-lnternally, this 

20 acknowledgement is transferred from the RR protocol to the BSSAP protocol 
(message 48) that sends the acknowledgement message further to the 
BSSAP protocol of the mobile services switching centre in message 49 
CIPHERING_MODE_COMPLETE. The RR protocol of the mobile station MS 
and the RR' protocol of the base station BTS transfer the encryption 

25 parameters and the encryption start command unit-internally to lower layers of 
the physical connection, which at the transmitting end carry out encryption 
and, at the receiving end, decryption for signals of the higher protocols. 

Figure 5 shows a theoretical layer description corresponding to 
Figure 3 in the case of IMT-2000 system entity. Again, the physical 

30 transmission layers 1 and 2 not taking part in the encryption are marked with 
dotted lines. Layers 1 and 2 may be implemented with the ATM protocol, for 
example. The CC protocol of the IMT-2000 system carries out call control, and 
the MM protocol in addition to location management of the mobile terminal MT 
initializes the connection encryption. A TAC protocol (Terminal Association 

35 Control) establishes a connection between the network and the mobile 
terminal MT. 
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Figure 6 shows a signaling chart for initialization of the IMT-2000 
system encryption. The encryption initialization is perfomned with an MM-T 
protocol (Mobility Management - Terminal) in a transparent way from the point 
of view of the radio access network RAN. The MSG transmits, by means of the 
5 MM-T protocol. an encryption initialization message 61 
MOBILITY_FACILITY_(START_CIPHERING: INVOKE) to the mobile terminal 
MT. The radio access network RAN transfers the message directly to the MT. 
which acknowledges the encryption initialization with message 62 
MOBILITY_FACILITY (START_CIPHERING: RETURN^RESULT). Message 

10 62 is also transferred to the MSG transparently from the RAN's point of view. 
The base station BTS and the base station controller BSC of the RAN, through 
which the messages pass, thus do not take part in the encryption and are not 
aware of the encryption. After the initialization, the encryption of the connection 
is perfomned between the mobile services switching centre MSG and the 

1 5 mobile terminal MT. 

Hence, the problem with the system configuration of Figure 2 is that 
the mobile services switching centre does not support direct transfer of 
encryption settings to the mobile terminal transparently over the radio access 
network RAN. A further problem is that the base station BTS of the RAN does 

20 not have a protocol to process the encryption settings, which could 
communicate with the corresponding protocol of the mobile terminal. This 
means that encryption initialization cannot be carried out between the base 
station and the mobile terminal. In a system configuration according to Figure 
2, it is therefore not possible with prior art methods to arrange encryption for 

25 the connection. 



Summary of the Invention 

It is an object of the present invention to implement encryption in a 
radio system configuration where the protocol processing the encryption 
30 settings of the base station is not able to communicate with the corresponding 
protocol of the mobile terminal. 

This new type of encryption setting is obtained with the inventive 
method, which is characterized by that which is set forth in the independent 
claim 1. Particular embodiments of the invention are disclosed in the 
35 dependent claims. 
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The invention is based on the idea that the control unit in the radio 
network transfers the encryption initialization settings needed by the mobile 
terminal to the mobile terminal, transparently from the point of view of the base 
station. According to one of the embodiments of the invention, the control unit 
5 in the radio network transfers the encryption initialization settings 
independently to the base station and the mobile terminal. 

Such an encryption setting provides the advantage that encryption 
can be arranged between units communication over the radio interface even in 
case the units are not able to exchange encryption initialization settings, as is 
10 the case with a combination of a GSM core network and an IMT-2000 system 
radio network. 

Brief Description of the drawings 

The invention will now be described in closer detail in connection 
15 with the prefen-ed embodiment, with reference to examples of Figures 2, 5 and 
7 in the accompanying drawings, in which: 

Figure 1 is a block diagram illustration of a radio system based on joint use of 
the radio network; 

20 Figure 2 shows the radio network of Figure 1 connecting to a GSM core 
network; 

Figure 3 shows the protocols that are essential from the point of view of the 
invention, for a connection in the GSM system as a layer depiction; 

Figure 4 is a signaling diagram of setting encryption to the GSM system; 
25 Figure 5 shows the protocols that are essential from the point of view of the 
invention, for a connection in the IMT-2000 system as a layer 
depiction; 

Figure 6 is a signaling diagram of initialization of encryption in the IMT-2000 
system; and 

30 Figure 7 is a signaling diagram of encryption setting according to the invention. 
Figure 8 is a signaling diagram of encryption setting according to the invention. 
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Detailed description of the invention 

The present invention is applicable to a combination of any radio 
systems. In the following, the invention is described by way of example mainly 
5 in connection with a combined core network of the digital GSM mobile 
communications system and the radio access network of the IMT-2000 
system. Figures 1 and 2 show the simplified structure of the combination of the 
radio systems, described in the above. For a closer description of the GSM 
system, reference is made to the GSM recommendations and 'The GSM 

10 System for Mobile Communications" by M. Mouly & M. Pautet, Palaiseau, 
France, 1992, ISBN: 2-9507190-0-7. 

In the following, the invention will be described in greater detail in the 
light of its preferred embodiment, with reference to Figures 2, 5 and 7. 

Figure 2 shows the example of the combination of radio systems, 

1 5 described above, in which the GSM system core network is connected to the 
radio access network RAN, The mobile terminal MT is adapted to 
communicate with the GSM core network over the RAN, so that the protocol 
stack of the mobile terminal, shown in Figure 5, consists of the GSM system 
MM and CC protocols, and otherwise of protocols required by the RAN, i.e. of 

20 the IMT-2000 system protocols in the case of Figure 5. If need be, the 
encryption settings can be handled at RBC (Radio Bearer Control) and BC 
(Bearer Control) protocol layers in the protocol structure of the RAN, and at the 
RBC protocol layer in the mobile terminal MT. 

Figure 7 is a signaling diagram for setting the inventive encryption at 

25 the protocol layers according to Figure 5. At the beginning of setting the 
encryption, the mobile services switching centre MSG transmits a command 
message to the radio access network RAN to initialize encryption (message 71 
CIPHERING_MODE__COMMAND). Message 71 is transmitted with e.g. the BN 
protocol of the GSM mobile services switching centre MSC, which is a protocol 

30 at layer 3 of the 1^ interface. The BN protocol of the base station controller BSC 
receives this command message and transfers it, BSC-internally, to the RBC 
protocol which handles encryption settings (message 72). Next, at two 
independent stages, the base station controller transfers the encryption start 
command on the one hand to the base station BTS and, on the other hand, to 

35 the mobile terminal MT. Figure 7 shows these two stages, so that initially at the 
first stage the encryption start command is transferred to the base station BTS 
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and then, at the second stage, to the mobile temiinal MT. The signalings at the 
first and second stages may also be carried out at least partly simultaneously, 
depending on the processing capacity of the BSC. In Figure 7, the first and 
second stages defined in the above are denoted with Roman numbers I and 
5 11. 

In the exemplary case of Figure 7. the BSC at the first stage defined 
above transfers, according to the present invention, the command message it 
has received from the MSG, from the RBC protocol further to a second BC 
protocol that handles encryption settings (message 73). The BC protocol of the 

10 base station controller transmits an encryption command (message 74 
ENCRYPTION_COMMAND) to the BTS's corresponding protocol, which the 
base station BTS acknowledges with message 75 
ENCRYPTION_COMPLETE. Messages 74 and 75 of the BC protocol 
between the base station controller BSC and the base station BTS are 

15 transferred on the transmission link using e.g. the ATM connection AAL5 
protocol. BTS-intemally, information on the encryption settings and the start of 
encryption is fonwarded to the physical transmission layer that takes care of 
the encryption process, after which the protocol of the physical transmission 
layer starts decryption with the given parameters, and, having received the first 

20 encrypted message from the mobile terminal MT, it also begins encryption with 
the given parameters. The BC protocol of the base station controller transfers 
the acknowledgement message of the base station fonward to the RBC 
protocol BSC-intemally (message 76). 

At the second stage determined in Figure 7, the RBC protocol of the 

25 base station controller sends an encryption start command 77 
CIPHERING_COMMAND to the corresponding protocol of the mobile tenninal 
MT. MT-internally, the RBC protocol transfers information to the physical 
transmission layer taking care of the encryption process on the encryption 
settings and the encryption start, after which the protocol at the physical 

30 transmission layer begins encryption and decryption with the given 
parameters. The mobile terminal MT acknowledges the encryption start 
message by transmitting message 78 CIPHERING_COMPLETE to the RBC 
protocol of the base station controller BSC. Messages 77 and 78 of the RBC 
protocol between the base station controller BSC and the mobile terminal MT 

35 are transferred by using e.g. the ATM AAL2 protocol. 
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After the first and second stages have been completed, the RBC 
protocol of the base station controller transfers, BSC-intemally, an 
acknowledgement to the BN protocol on the encryption settings having been 
sent to their destination (message 79). The BN protocol of the base station 
5 controller sends the acknowledgement message further to the corresponding 
BN protocol layer of the mobile services switching centre MSG (message 80 
CIPHERING_MODE_COMPLETE). 

Due to the setting of encryption, described above, the connection 
between the base station BTS and the mobile terminal MT can be encrypted 

10 over the radio interface. The proper encryption carried out over the radio 
interface is e.g. similar to that used in the GSM system. 

In another embodiment of the invention, the encryption setting is 
transferred from the base station controller BSC to the mobile terminal MT 
only, when connection encryption is implemented between the BSC and the 

15 MT. Figure 8 shows this embodiment as a signaling diagram. At the beginning 
of encryption setting, the mobile services switching centre MSC transmits a 
command message to the radio access network RAN to initialize the 
encryption (message 71 CIPHERING_MODE_COMMAND), with e.g. the BN 
protocol. The BN protocol of the base station controller BSC receives this 

20 command message and transfers it, BSC-internally, to the RBC protocol that 
handles encryption settings (message 72). BSC-internally, information on the 
encryption settings and the start of encryption is transferred from the RBC 
protocol to the physical transmission layer that takes care of the encryption 
process, after which the protocol of the physical transmission layer starts 

25 decryption with the given parameters. Next, the RBC protocol of the base 
station controller sends an encryption start command 77 
CIPHERING_COMMAND to the corresponding protocol of the mobile terminal 
MT. MT-intemally, the RBC protocol transfers infomriation to the physical 
transmission layer taking care of the encryption process on the encryption 

30 settings and the encryption start, after which the protocol at the physical 
transmission layer begins encryption and decryption with the given 
parameters. The mobile terminal MT acknowledges the encryption start 
message by transmitting message 78 CIPHERING_COMPLETE to the RBC 
protocol of the base station controller BSC. Message 78 may be transmitted 

35 encrypted with the given parameters. Messages 77 and 78 of the RBC 
protocol between the base station controller BSC and the mobile terminal MT 
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are transferred between the BSC and the BTS by using e.g. the ATM AAL2 
protocol. Next, the RBC protocol of the base station controller transfers, BSC- 
internally, an acknowledgement to the BN protocol on the encryption settings 
having been sent to their destination (message 79). The BN protocol of the 
5 base station controller sends the acknowledgement message further to the 
corresponding BN protocol layer of the mobile services switching centre MSG 
(message 80 CIPHERING_MODE_COMPLETE). The protocol of the BSC 
physical transmission layer starts encryption with the given parameters once it 
has received the first message encrypted with these parameters from the 

1 0 mobile terminal MT. 

In the second embodiment of the invention, encryption settings of an 
existing connection are changed in the middle of the connection, with e.g. the 
signaling shown in Figure 7 being used to transfer the new encryption settings 
to the units handling the physical encryption. In the following, the second 

15 embodiment of the invention is described in greater detail with reference to 
Figure 7. 

In the second embodiment of the invention, the encryption setting 
messages 71-73 are transferred the way described above in connection with 
the preferred embodiment of the invention. Further, at the first step of the 

20 second embodiment, the base station controller BSC transfers encryption 
setting message 74 to the base station BTS by using e.g. the BC protocol. The 
base station acknowledges this message with message 75. The 
acknowledgement is transferred, BSC-internally, in message 76 as described 
above in connection with the preferred embodiment. BTS-internally, the new 

25 encryption settings and information on the change in the encryption are 
transferred to the physical transmission layer handling the encryption process, 
which, after receiving the new settings, continues encryption and decryption of 
the connection between the base station BTS and the mobile terminal MT 
according to the new settings, for example by changing the encryption 

30 algorithm being used. 

At the second stage of the second embodiment, the base station 
controller BSC transparently transfers encryption setting message 77 to the 
mobile terminal MT via the base station, by using e.g. the RBC protocol. If the 
encryption setting message 77 is transmitted to the mobile terminal MT in 

35 encrypted form over the radio interface, the old encryption settings are 
employed for the encryption, for example the encryption algorithm to be 
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changed into a new one. MT-intemally, the new encryption settings and 
infonnation on the change in the encryption are transferred to the physical 
transmission layer handling the encryption process, which, after receiving the 
new settings, continues encryption and decryption of the connection between 
5 the base station BTS and the mobile terminal MT according to the new 
settings, for example by changing the encryption algorithm being used. The 
mobile terminal MT acknowledges reception of the new encryption settings 
with message 78. Again, if acknowledgement message 78 is to be transmitted 
in encrypted form at the radio interface, the new encryption settings delivered 

10 in encryption setting message 77 are used, e.g. the new encryption algorithm. 
Acknowledgement messages 79 and 80 are transferred the way described in 
connection with the preferred embodiment of the invention. 

The drawings and the description related thereto are only intended to 
illustrate the idea of the invention. The inventive method may vary in details 

15 within the scope of the claims. The messages and protocol layers according to 
the example described in the above represent but one implementation 
alternative and the invention is therefore not restricted to transmission of these 
messages or the presented protocol layers. Although the invention is in the 
above described mainly in connection with a combination of a radio access 

20 network RAN of the IMT-2000 system and the GSM core network, the method 
is applicable for use in another type of radio system, particularly in case the 
units taking part in the encryption cannot communicate encryption settings to 
one another directly. The invention can be employed in a public radio system 
formed as a combination of the radio access network RAN, or similar, of the 

25 IMT-2000 system and the switching centre of a core network, in which 
encryption settings are not transferred transparently from the switching centre 
to the mobile terminal over the radio network. 
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Claims 

1. A method of setting encryption for a connection in a radio system 
which comprises a plurality of mobile temninals (MT). at least one switching 
centre (MSG) and at least one radio access network unit (RAN) 

5 communicating with the switching centre, the RAN further comprising at least 
one control unit (BSC) and. under its control, at least one base station (BTS). 
the handling of the encryption settings between the switching centre (MSC) 
and the base station (BTS) in the radio system being earned out at different 
protocol layers than the handling of the encryption settings of the mobile 
10 terminals (MT), the method comprising the steps of 

transmitting an encryption setting from the switching centre (MSC) to 
the control unit (BSC) of the radio access network unit (RAN) and 

encrypting the connection between ^the radio access network unit 
(RAN) and the mobile terminal (MT) with the encryption settings, 
15 characterized by the method comprising the step of 

transferring the encryption setting from the control unit (BSC) to the 
mobile terminal (MT) transparently from the base station (BTS) point of view, 

2. A method as claimed in claim 1. in which the connection between 
the base station (BTS) and the mobile terminal (MT) is encrypted with the 

20 encryption settings, characterized in that the method comprises the 
step of 

transferring the encryption setting from the control unit (BSC) to the 
base station (BTS) for exclusive use by the base station. 

3. A method as claimed in claim 2, characterized in that 

25 the encryption setting is transferred from the control unit (BSC) to the 

base station (BTS) with a first protocol, 

the encryption setting is transferred from the control unit (BSC) to the 
mobile terminal (MT) with a second protocol, which is different than the first 
protocol. 

30 4. A method as claimed in claim 3, characterized in that to 

transfer the encryption settings 

a message is transmitted from the control unit (BSC) to the base 
station (BTS) to inform the base station of the encryption settings (74), 

a message is transmitted from the base station (BTS) to the control 
35 unit (BSC) to acknowledge the encryption settings of the base station (75), 
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a message is transmitted from the control unit (BSC) to the mobile 
terminal (MT) to inform the mobile terminal of the encryption settings (77), and 

a message is transmitted from the mobile terminal (MT) to the control 
unit (BSC) to acknowledge the encryption settings of the mobile terminal (78). 
5 5. A method as claimed in claim 4, characterized in that the 

acknowledgement message (75) on the base station encryption settings is 
additionally transferred control unit (BSC) intemally from one protocol to the 
next. 

6. A method as claimed in claim 4. characterized in that 

10 the information message (77) on the encryption settings to the 

mobile terminal is encrypted with the old encryption setting, and 

the acknowledgement message (78) on the encryption settings from 
the mobile terminal is encrypted with the new encryption setting. 

7. A method as claimed in claim 1, 2 or 3, characterized in 

15 that 

the encryption setting is transferred in the middle of the 
communication connection to change the encryption into another. 
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